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-ms invention relates to a method of controlling application devices, the 
method comprising the steps of 

■ - ^^vingfitstdooameatsftomafirstsetofapplicationdevicesbyaserver. 
_ retrievingidentiflcationofauserbythesetver. 

Fxomtoprio,artmfl» aslstep.it is taown.ore«ev.dooumen,.t„a 
^e, ftom appUcation devices pr««*. It is also kno«n. in se^nd step, to remove 
information, by an id, to idendijr a user. 

Th.prascminven,ion£Wh«relatesU>asysteni£orcon.rollingapplicaaon 

devices comprising: ^ovires bv a 

_ nreansfoxrerievingfirstdocumentsftomafixstsCofappUoatrond^bya 

server; 

_ meansfotiotrievingidcnBficationofamerbytheserver, 

The present invention further relates to a computer system for performing the 

method. 

■ae present invention fUrto relates to a computer program product for 
20 performing tiie method. 

Itisknownftomflte wldofthelntemetthatWebuserse^cpresstheir 
M„rmaaonneedseKpUciUybycUc^gonah,perlin.orbyenteringat^^^^ 

, T mT^/rT \ fnrm field of a browser runnmg on a cUent. ims 

Hvner Text Markup Language (HTML) tormneiaoi a 

^onisprocessedat the se^er side, andanotherHmLdoc^entd^tcon^msthe 
:linssentbaclctotheWebbr„v^on,hecUentside.T.euserir.terac.sv„e^^ 
documenta.a,ime,i.e.theuser generaUy e^Ucitly interacts with a smgle Btten^ble 
Xueguage(^)browserrunningonahardwarepla.«>rm^^ 

the Internet. 
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WO 00/60488 discloses a method and an apparatus for controlling brovraer 
functionality using HTML and XML documents for an application specific control of a 
device. Biowsct functionality is configured according to user profile information specifying 
the authorization and preferences of the user. The user can modify each of the documents for 
the application specific control within the display of an application window for the device to 
be controlled. The documents for the application specific control are responsive to user 
activations of the browser. 

However, the above prior art method involves the problem that when more 
electronic devices connected to a server by means of the Internet, and thereby controlled by 
the browser functionality of the server, need to have new parameters or setting, then by use of 
an entry field of the browser, for each device, the user has explicitly to key in a Uniform 
Resource Locator (URL) with parameter(s), to enter a textual command, or to click on a 
particular hyperlink to control a device. This is very time consuming when many devices 
have to be controlled. Additionally, it is further inconvenient that each time flie user has to 
tell the server about his preferred setting or parameters of each of the devices he desires to 
control and or v^ere he is now. 

The above problem is solved by an implicit control of the application devices 
in that the said metiiod is characterized m that the method further comprises the steps of 

- generating second documents by the server, each comprising an instruction, on the 
basis of at least a part of the retrieved identification of the user and at least a part 
of the first docvunents; 

- sending at least one of the second documents to each device of a second set of the 
application devices by the server and 

- performing, for a given device ofthe second set, one instruction from at least one 
of the second documents received in the given device. 

As a resxilt ofthe first step the server generates other documents, having at 
least one instruction, on the basis ofthe identified user and at least a part ofthe first 
documents reflecting the status of the application devices, prior to any change. 
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As a Ksult of the second step, the server simultai^mly sends one or more 
documents to the application devices. 

As a result of 4e third step, the Sfppii^o^ devices can simnltaneonsly 
perform ins^ctton of the received documents to change parameters and or sitings. The 
changed parameters or settings reflect the preferred setting of the identified user. 

By these three steps, the problem of the time consuming use of fte entry field 
of,hebrovvser,thelceyinginoftheUM.withparameter(s),ortheen.eringofti»t«^ 
„™„and. and or ti» cUckmg on ti>e hyperlink in order to connol each appUcation devu>e . 
solved mtiu* the user should no. expHcifly click, type, etc. for each of the apphcation 
devices surroundinghhnorher.aa.hissettingandorti»separameters were a^^^^^ 
WerredU, the appUcattondevices when ti» user was also au«,ma.,caUy ulentificdby the 



servar. 
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An advantage of the invention is that there is backward compatibiUty 
older XML-based application devices likethelnten^etRadioFW^lOOOIntem^^ 

slelf system of Philips. The Internet radio accepts to receive MPEG-1 Audio 1^-3 (MP3) 
Ulsat^ytin.eand.on.wMchitn.ayplayselectedn.nsicofauser.mMP3^^^^^^^ 

LLfonn of one or more docunxentscouldbesendto the Internet radio va^outany user, 
interaction- 

Anoflwr advantage of tire invention is that tiierc is also ensured backward 
compaflHU^wiarnewerXML-basedlanguagesinfl>atoldappUcationdevicespri^^^ 

„,.d„^ Older XMI^ased languages may receive a subset of commeu^ds from ^e new 
XML^languagehrtheoMKML language. Further it may bepossibleti.toldapphca.ron 

devices are updat^lbyasoftwaredownloadtounderstandnewer languages, e.g any update 
or revision to XMI^based languages or tire like languages. For ti«se re«ons older 
appUcation devices will not be obsolete when «« present Invention is hnplemented. 

Anoflrer preferred embodiment of the mvention is described m dahn 2. 

Hereby, user profile and context profile information may be used to reflect tire 
use^s interests andphysicalposition. The user profile may comprisetheuseesprdtoed taste 
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of music, movie, art and how these may be combined. Further, the user profile may comprise 
settings of light and or the settings and or parameters of other application devices in his or 
her home, or elsewhere, e.g. in a shopping centre, etc. Further the user profile may comprise 
or have the possibility of retrieving and or to being given information about the user's mood 
by means of the server. 

The context profile information comprises information about the environment 
and or the application devices present in the particular environment of where the user may be 
at any moment. 

By the informatipn in these two steps, the problem associated with the user 
each time having to tell the server about his preferred setting for the devices surroxmding him 
and or where he is, is solved in that the user profile and the context profile infomiation reflect 
the user's preferred settings and or where the user is. 

Other embodiments of the invention are described in claims 3 and 4. 

Hereby the said application devices may be hnplicitly, simultaneously 
controlled by different docximents in that a document such as at least one of Hyper Text 
Markup Language, Scalable Vector Graphics, Resource Description Framework and 
Extensible Markup Language (XML) is sent to the application device, before a possible 
another document or docinnent type is modified or generated by the server. 

The above problem is also solved by an implicit control of the application 
devices in that the system for controlling application devices is characterized in that the 
system further comprises: 

- means for generating second documents, each comprising an instruction, on the 
basis of at least a part of the retrieved identification of the user and at least a part 
of the first documents; 

- means for sending at least one of the second documents to each device of a second 
set of the application devices; and- - 

- means for performing, for a given device of the second set, one instruction firom at 
least one of the second documents received in the given device. 
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A preferred embodiment of the system according to the invention is described 

in claim 6. 

The invention wiU be explained more fully below in connection with preferred 
embodiments and with reference to the drawings, in which: 

Fig. 1 shows an example of a responsive environment. 

Fig. 2 shows an example of location-aware services. 

Fig. 3 shows an example of hypermedia portals, 

Fig. 4 shows an example of daily routines, and 

Fig. 5 shows a method of controUmg application devices. 

Figure 1 shows an example of a responsive environment. In a first preferred 
embodunent of the invention, imagine that three persons are sitting in a living room. Two of 
them happen to be romantically engaged and the other is a fiiend who visits the couple. Tlie 
room contains different application devices, such as reference numeral 103, a telephone, 
reference numeral 105, an audio player or radio, reference numeral 104, an electronic 
background wall (as a wide screen television) as well as several lamps, reference numeral 
106. All these appUcation devices or appliances may have an Internet connection or another 
network connection in order to be able to send information and to receive information from 
the Internet or another network in XML format The audio player or radio may be playing 
dance music, the telephone may be on and the electronic background may show images or 
video clips that match the music. The lamps may be on. These appUcation devices may 
continuously send information in the form of documents to reference numeral 107. aserver 
on the Internet or another network that may analyse differences in reference numeral 1 0 1 , the 
environment surrounding the home of reference numeral 102, the user or more users. 

In the rest of this document, the term server may also be understood as a 
document adaptation server. Generally, the server may have or have received a given set of 
(first) input documents from the application devices comprising of user and context 
information. The server then uses it intelligence to compute and or to generate a (second) set 
of output documents, which are sent to the application devices. The server may use the 
context and the user profile contained in the first set of documents to calculate the content 
and a structure in the second set of documents, which may describe what each appUcation 
device that participates in the user experience should do. 
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Now assume that the Mend may go away. The server may recognize the 
change in the number of present persons and may start searching for documents that now 
better match the present users profiles and their context profile for all the application devices 

5 that surround the two users. The user profile may contain information about the users 

preferred music style, movie genre, preferred art and how these may be combined. Further 
tile user profile may comprise settings of light in a continuous range of min to max power to 
the lamp. Further the user profile may comprise or have the possibility of retrieving and or be 
giving uiformation about the user's mood by means of the server, it may be the mood of glad, 

10 in love, sad, angry, thoughtful, etc, and combinations thereof The mood of the user may 

jfiirther be used to determine setting for the application devices, reference numerals 103, 104, 
105 and 106 such as the audio player, the telephone, the electronic background and the 
lamps. Continuing the example, after the fiiend left the room, the server, reference numeral 
107, may send, as showed by reference numeral 112,113, 114 and 111, XML documents to 

15 each of the individual application devices to play romantic songs on the audio player, to show 
a movie of a panoramic view on the river Seine on a rainy day in Paris on tiie electronic 
background wall, to shut off the telephone for bvisiness calls and to dim the lights. Reference 
numeral 1 12 may be the XML document for the audio player, reference numeral 113 may be 
the XML document for the electronic background wall, reference numeral 1 14 may be the 

20 XML document for the telephone, and reference numeral 111 may be the XML documents 
for dimming the lights. Reference numeral 1 1 1 may primarily be the same XML document 
for each of the lamps, as the same function, dimming tiie light, may have to be performed m 
the same way for all the lamps. It can be seen from the example of responsive environment, 
tiiat tiie server implicitiy referenced multiple XML documents. Prior to sending the 

25 documents, reference numerals 1 1 1, 1 12, 1 13 and 1 14, other documents, as reference 

numarals 1 08, 109, 110, may have been retrieved from the correspondmg application devices, 
the audio player, the wall and the telq>hone to reflect a status of these application devices 
prior to any adjustments of their settings. Even the light may be able to generate documents 
to reflect a status of the light prior to any adjustment of the light. As an example, it may be 

30 useful information firom any of the lights, reference numerals 1 06, whether any of the bulbs 
in the light is dead or is .still able to emit light When the documents, reference numerals H 2, 
113, 1 14 and 111, were sent, these docxunents were then used implicitly to control the 
corresponding application device, i.e. audio player, wall, telephone and lights. The user 
should not e)q)licitly click on a hyperlink or enter a textual query in an HTML form field of a 
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browser for each ofthese application device. In order to recognize or identic 
in the responsive environment or in any other surrounding, tiie server may retrieve 
identification of user(s). The user(s) may be recognized by means of an RF tag, a tag, a bar 
code, an IRIS scan, or by entering a personal identification to the server. Reference numeral 
1 1 5 will be used in the figures 1 through 4 to show the recognition or identification. It may 
be the case that more users, e.g. a family, a gro^, etc., are identified by means of reference 
numeral 115. 

Figure 2 shows an example of location-aware services. In another preferred 
embodiment of the invention, imagine tiiat auser, reference numeral 202 enters a shopping 
centre illustrated by reference numeral 201 as the enviromnent surrounding the user, and the 
user does not know where he or she can buy a particular item at a good price in Ihe 
neighbourhood. The user may carry a Web tablet as an application device illustrated by 
reference numeral 203 with him. and the shopping centre may have one or more other 
application devices as electronic information panels illustrated by reference numeral 204. Vf^e 
Web tablet may be a wireless device with the display of the size of an A4 page, and as an 
example the web tablet may fi^er be used to browse the Internet or browsing by means of 
another network comxection. AppUcation devices such as Mobile phones. Personal Digital 
Assistants (PDA), and all other wireless devices with a screen which may easily be earned by 
a user may be also be used in the following examples instead of the Web tablet, when the 
Web tablet is mentioned. The electronic information panels may show general information 
andinfomiationdedicatedto agroup or to a dedicated user. Both the Web tablet and the 
information panels can exchange data in the fomi of an XML document with the Internet or 
another network comiectioa The Web tablet may continuously sent information m XML, by 
means of tiie XML document, reference numeral 206 to reference numeral 205, the server 
about the user's location in the shopping centre and may be also information about where the 
user is located in the shopping centre, i.e. the exact coordinates in tiie shopping centre, which 
may be converted to a specific shop in tiie shopping centre. The server retiieves and 
recognizes tiie context profile, i.e. tiie user enters a shopping centre, and searches for XML 
documents tiiat match tiie user profile: The server may send a personalized HTML document, 
reference numeral 208, ttiat contains a Ust of interesting shops near tiie Web tablet; tiie same 
mformation may alternatively be sent tiirough anotiier generated document direct firom 
reference numeral 205. tiie server, by means of a document, reference numeral 209, to 
reference numeral 204. tiie information panels tiiat highlight tiiese shops on a map displayed. 
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This document, reference numeral 209, may be a newly generated SVG document, where 
SVG is the abbreviation for Scalable Vector Graphics, which is an XML-based standard for 
describing graphics in XML (as an example see in the URL 

http://www.w3.org/Graphics/SVCj/Ovcx*view.hlm8#morcV The server, reference numeral 
5 205, may first retrieve reference numeral 207, a SVG document retrieved from reference 
numeral 204, the information panels and thereafter generates reference numeral 209, a new 
SVG document. In the same way reference numeral 208, the HTML document, may be 
generated. In otlier words, prior to the sending of these documents to the information panels 
and the Web tablet, these documents were updated and or generated to reflect the context 

10 profile and the user profile. As the user walks through the shopping centre, both the contents 
in the form of the document sent to the Web tablet and sent to the information panels may 
change. From the example of location-aware services, it can again be seen that multiple 
documents, reference nimierals 206, 207, 208 and 209, were referenced and or generated. The 
Web tablet and the server referenced multiple documents, i,e. the HTML documents and the 

15 SVG documents through the Internet However, instead of using the IntOTtiet any other 

network with means for sending and receiving documents may have been used as well. The 
documents were generated, and then used to put information on the Web tablet and on the 
information panels prior to sending, 

20 In this example, when documents were sent, these documents were then used 

implicitly to control the corresponding application devices, electronic information panels, etc. 
The user entering the shopping centre should not explicitly click on a hyperlink or enter a 
textual query in a form field of a browser on his Web tablet to retrieve personal information 
for each application devices; instead, docxmients were used implicitly to control the 

25 electronic information panels, etc. without any direct user interaction. 



embodiment of the invention, a femily may be sitting behind an application device such as a 
large flat-screen TV, reference nxmieral 305 with broadband Internet access or another 
30 broadband network access in a third scenario. The scenario, reference nimieral 301 , may be 
the family, reference numeral 302, sitting together in the living room* Extensions of the 
HTML language or more informative multimedia Web presentation languages may be used 
in documents; the dociraient being retrieved and sent in this scenario may be a hypermedia 
document with interaction support, the hypermedia document may have brought TV-like 



Figure 3 shows an example of hypermedia portals. In another preferred 
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Zennedia portal, referee numeral 306> appUoafon dcv.ce, ^ TV. ref«c^ 
!^305 maybeusedforpresen«io„3ofmultimediaco«»tao<loth«apphca«ona. 

^1^11 we. portals .uoh aa Yal^o and AOUAn>»ica on line) ««y prov^e » 

i~ven,e.oLn.™Ued.TV.,l,.uae.ln,e*oeino,d«.c^ap»^^ 

easy menu * „ tu^ TV F5v wav of example the personalized 

om^e 1 , here v^th reference — 304. may UnpUci«y reference »nlt.p^ ^ 
server oi fig document wilii reference numeral 307 

"T"~rr^^eved*onr^lar.fla.^TV.refere^ 

^r:::leLse^.-.oreenTVand.eHyperrnedlapor.al.I-ca^^^ 
rlss.ototWeofmediaandorth..ypeofmeswMchn>aybepresen.ed.playM. 

rl^I T,.etfom>a«onflo«ng 4e opposite way. Aedoo^nent generated v«h 
linked to etc. 1 ne miorawu ^ document sent to 

^eenun«ral303 by ae server may agambeanXNfl..HTMLo^SV 

fl,.TVreferencennmeral305,mordertogiveinformadontoaieTVaboutthensers 

!:^'^^sprofilemaybensedby*eTV.opresen.medlao.a.ypeandoraco^ 

, !^L.byfl>enLorpreftrredbya»f^y.-n.edocumen.ofreferencen„»erals303 

^.!yLerbe.^.diadocuments.v*ichmaydesoribebowmultu„ed.aoo^^^ 

T !I r aX imag» video, text) are *uct„red and hyper-linked «. ofter documents. A 
Ty;:!?.:— m;ya.,ow.beuser.cUc.onmea.con^^ 
ranewdocumen^anewbypermedla^^^d^^— 
;0 official World Wide Web Consortium (W3C)SMIHbyncnrom 

—Js^ndardmaybeanexampleofahypenHedialanguageforahypermed^ 

:rl^^esedocumen.may*enbeused.con».l««byp^e^PO-^^ 

uv^uu. c*»rvices which is shown m that reierence 

different on-line information entertainment and or services, wmcn is s 

differenton „,av be transferred between reference numeral 304, 

numeral 303, a document or documents, may oe xransic 
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the server, to reference niuneral 306, the hypermedia portal or browser of the TV, where the 
document is interpreted to show media content in the hypermedia browser running on the 
flat-screen TV hardware. The hypermedia portal of the TV may be described by a set of 
hypermedia documents, generated on the server, and displayed in the hypermedia browser 
nmning on the flat-screen TV hardware. Just like in the previous two figures, the hypermedia 
browser running on the flat-screen TV hardware may send information to the document 
server that may control or give the appropriate information back to the personalized 
hypermedia portal in tiie form of other documents. This server may retrieve, reconstruct, and 
or generate documents based on the user profiles and context profile descriptions. A set of 
hypermedia documents - such as reference nimieral 303 - describing the presentation of and 
interaction with the personalized multimedia content and applications may be sent back to the 
hypermedia browser running on the flat-screen TV hardware. 

Figure 4 shows an example of daily routines. In another preferred embodiment 
of the invention. Figure 4 describes a situation, reference numeral 401, of a femily or a user, 
reference numeral 402, waking up and preparing for the day. In the example the family or the 
user may be doing daily rituals such as having a shower, having breakfast while listening to 
music and planning the rest of the day. Document personalization technology by means of a 
server may be used to facilitate daily rituals such as rituals in waking up and having 
breakfast, etc. in this example of a preferred embodunent of the invention. Assume that an 
alarm clock, reference numeral 406, goes ojff, it may be the alarm clock in an application 
device like reference numeral 405, a Web tablet programmed to give a walce up call; the Web 
tablet may trig a schema script on a server, reference numeral 413, or send a document, 
reference numeral 403, to the server, and thereby make the Web tablet send another XML 
document, reference numeral 403 back to the server 404. The XML docxmients, reference 
numerals 403 and 413, may further comprise context profile, user profile information, etc. 
The context profile information in this scenario may comprise bath and living-room, morning 
and breakfast. The user profile information - based on identified users - may comprise 
information about all persons in the family, reference numeral 402, and their prefeired 
interest in media content, soft-drink tastes such as coffee or tea, etc. By means of different 
documents, reference numeral 407, dedicated to reference numerals 408, 409, 41.0, 411, 412, 
different application devices, i.e. electronic controllable application devices with Internet 
access or other network access surrounding the user or users of the family, may be activated 
by sending the docvmients, reference numeral 407 to these application devices. By means of 
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other different documents, reference numeral 414, dedicated to reference numerals 408. 409, 
410 411 412, the appUcadon devices may send documents back with their correspondmg 
states infomiation to reference numeral 405. the Web tablet, prior to the receiving of 
documents from the Web tablet A document may control an appUcation device such as the 
bath, reference numeral 408 toapre-adjusted temperature and or flow of water, and another 

document may relay an audio chamiel to another ^pUcation device, a radio, reference 

numeral 409, in the bathroom. If the user leaves the bathroom, and shouts "breakfestl". a 

breakfast script in the Web tablet, reference numeral 405, may become active. IHe shoutmg 

of the user may be recognized by means of another application device, (not shown), hke a 

nucrophone m the Web tablet. When the breakfast script is active in the Web tablet, the other 

application devices such as reference numeral 410. a TV, reference numeral 411 . and a lamp 

in a livmg room may be switched on. The application devices may have been activated 

simultaneously by the sending of corresponding documents, reference numeral 407. to these 

devices, reference numerals 408. 409, 410, 41 1 , at the same time. IHe documents of 
reference numeral 407 and413 may have beenupdated or may have been generated to reflect 

the context profile and the user profile, prior to the sending of these documents. The 
documents may comprise instruction about dedicated settmg for an application device. 
Examples of instructions for an application device may be instructions in the document for 
the TV and instructions in the document for the lamp: the TV may be tuned to the mormng 
news, and the lamp may be set to 100 Watt. Meanwhile, an HTML document describmg a 
personal agenda of the user may first be generated and then be lo aded in the Web tablet on 
the kitchen table, and another electronic device, reference numeral 412, a coffee machme, 
xnay be activated via instructions in the received document to brew coffee. Hie personal 
agenda of the user loaded in the Web tablet may be used to show the planned and scheduled 
activities for the day and the evening for the family or the user. THe coffee machine as well 
as the other application devices mentioned in this and the foregoing examples may be 
designed with access to the Internet or another network to ehable these devices to receive 
information and instructions in the form of documents. The documents may comprise 
personalized setting and or instructions for each device for controlling the behaviour of the 
device. Assume that a big family all like coffee in the morning, the document for the coffee 
machine may comprise the information with the mstruction: 1 6 coups, black coffee with the 
temperature 88 degrees to be finished 6:30 in the morning. 

Generally, the Web tablet may send information to the document server that 
may reply with generated documents, reference numeral 414, for the application devices 
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surroxmding a user or a family, or the Web tablet may itself generate documents, reference 
numeral 407 for the application devices in the scenario. 

Figure 5 shows a method of controlling application devices in another 
preferred embodiment of the invention. In step 500, the method is started. Generally when 
the application devices and the server are powered up, various initialisations of variables, 
parameters, user profile information, context profile information, etc. are set to default 
values, if no usable values are present. After this starting point, the method proceeds to step 
501. 

In step 501, the server may retrieve first documents firom a first set of 
application devices; as a result of a user entering a scenario, (how is explained in the next 
step), the present application devices may simviltaneously send documents to a server on 
request or by themselves. Prior to the retrieving of documents, the server may send 
commands in the form of other documents to the application device to ask or to give order to 
send first documents about their status, and thereby retrieve corresponding documents from 
the present application devices. The documents retrieved by the server may such as in the 
example of Figure 1 reflect the status of the application devices present As a simple 
example, light may give information about whether any of the bulbs in the light is dead off or 
is still able to emit light, as anotiier example, the audio player may give information about the 
sound level, in order to prevent the sound level at a future adjustment from being changed too 
fast, as this may be unpleasant to the user of a personalized environment. 

In step 502, the server may retrieve identification of a user. Generally, 
reference numeral 115 of the foregoing Figures shows the identification of the user(s). The 
user entering a scenario may be recognized by means of a hand-carried application device 
such as a Web tabled which may inform the server that a user has just entered the scenario 
with a particular identification. The user may be also be recognized by means of an RF tag, a 
tag, a bar code, IRIS scan, or by entering a personal identification to the server. On the basis 
of any of the means for identification, the server may retrieve user information. In may be the 
case that more users, e.g. a family, a group, etc., are identified. 



In step 503 the server may retrieve user profile information based on the user 
identification. On the basis of one or more identified users, the server may retrieve user 
profile information from another server by means of the Internet or any other network, or 
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from already present user profile infonnation on the server itself. Even the hand-carried 
application device, the Web tablet, or any other hand-carried or portable appHcation device 
may provide user profile information based on the user identification. When a user is 
surrounded by media player ^pUcation devices such as DVD, VCR, radio, set-top boxes, etc. 

5 the user profile information may comprise information about the user's preferred music style, 
movie genre, art and how this particular items of information may be combined. As an 
example, the user profile may comprise preferred settings of bulbs in lamps in a Uving room. 
For members of a family, each having a user profile, the user profile of interest for breakfast 
may comprise the preferred interests in soft-drinks, coffee, tea, milkshake with or vwthout 

10 sugar, etc. Further the user profile may comprise or have the possibiUty of retrieving 

information by means of the server about each of the user's moods, as the moods may affect 
the setting of the surrounding application devices. 

In step 504 the server may retrieve context profile information relating to the 
15 surroundings of the user. Like in the previous examples the surroundhigs of the user may be 
in the Uving room, in the kitchen having breakfast etc. Hie user may have moved to other 
surroundings outside the home such as a shopping centre, an airport etc. In other words, the 
context profile information as retrieved by the server may comprise the environment and or ■ 
the application devices present in the particular environment and or surroundings of where, 
20 the user may be at any moment. From the information retrieved fix,m the appUcation devices 
present in a particular environment of the user, the server may derive the situation of the user, 
e.g. when the application devices present are a shower with electronic control of the 
temperature and the flow of water, a coffee-machine and or a toaster, the user is most likely 
at home in the kitchen or in the bathing room. An airport, a shopping-centre, etc, in principle 
25 any place, may have an identification code retrieved from the server about the context profile 
information of the user being present at the place. The identification code about the context 
profile information may continuously be sent to a server by means of the Internet or another 
network The user in a scenario may have with him a hand-carried application device such as 
a Web tablet, which may inform the server that the user of the Web tablet has just entered a 
30 context with a particular context identification code. 

In step 505 the server may generate second documents, each comprising an 
instruction, on the basis of at least a part of the retrieved identification of the user and at least 
a part of the first documents. In other words, on the server, on the basis of some of the 
retrieved first documents and mthe basis of some of the retrieved identification of the user. 
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and optionally further based on the user profile information and or based on the surrotindings 
of the user; the server may generate second documents, each comprising an instruction. The 
number of second and first documents may differ, e.g. more first documents may have been 
retrieved than the number of the second documents than necessarily to generate second 
5 documents. The opposite may be also the case; the nimaber of second documents may be 
higher than the number of first documents (in the case that some of the application devices 
failed to send first documents for technical reasons), and the server may determine that the 
surroundings to control may require information to all application devices present in the form 
of the second documents. Additionally the server may use extra intelligence and or other 

10 sources of information to generate second documents. The extra intelligence may be 

computing power provided outside the server, and other information sources refining the 
creation of second document may also be provided firom another computer accessible from 
the server. The instruction or the instmctions in the second documents may comprise settings 
and or parameters for application devices, in order to control the functionality of the devices, 

15 e.g. adjusting the volxmie of an application device such as a TV, a radio, a DVD player, etc. 
The instruction may be generated on the basis of the retrieved setting of these devices, the 
user profile, and the context profile as well as the mood of the user. 

In step 506 the server may simultaneously send at least one of the second 
20 docimients to each device of the second set of the application devices. In this step, all the 
necessary information may now be present on the server; the server may thereafter 
simultaneously send documents to each device of the second set of the application devices. In 
other words, at the same time all the application devices needing update of settings and or 
parameters, i.e. in the form of documents, may have docxmients sent to them firom tiie server, 

25 

In step 507 any device of the second set of application devices may perform 
one instruction firom at least one of the second documents. In this step, one or more of the 
application devices that received a docimient may perform one or more of the instructions of 
the received document The document received may be dedicated to the application device, 
30 however, in the situation when the application devices are alike, they may receive the same 
document. It may further be the situation. that non-rlike application devices xeceived the^ame 
document, thereafter these application devices may use only the instruction or the 
instructions of the document usable for changing their parameters or settings. The instruction 
may comprise dedicated setting for the application device. The functionality of the 
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^pUcaaon <tevic« is aflected staultai^ously in that the documents sent to the appUcation 
d«viee were sent simultaneonsly torn the server, to other words, a user entering a room 
surroutuied by appUcafion devices, being recognized by means of some kind of identification 
code, may experience that *e wli«a«on devices present at the same time tespond to hma or 
5 her i.e. in Are Uving room. Ae user will a* the same time experience adjustments of lights and 
playing of user preferred music on the DVD player of the user's hi-fi equipment The user 
shouldnotexpUcitlycUckonahyperlink or enterate-dual query ina&rm field ofabrowser 

on a server for each of the appUcation devices in die Uving room to control these, as ttese 
settings were a>«omatically applied to the appUcation devices in ftat he or Ae enteral the 
10 living room. 

NormaUy, the method will start from the beginning again in step 501, as long 
as the server is running and at least one of the application devices is able to receive and send 
and or perform instmetion.. Otherwise, the method may termmale in step 508, however when 
1 5 just one of the application devices and the server are powered again, the method may proceed 
from step 501 again. 

I 

The mentioned server may also be understood as another powerful device with 

network or Internet access, the server may therefore be a powerful pc, both acting as a server 
and or asacUent; the term server may also beapower full device primarilynsed to present. 

media such as a Video Cassette Recorder, a set top box, a DVD player or any other power 
ftai electronic device that may present media information. 

The distinction between the said server and the said application devices may 
be smaUer than mentioned so far, in that both the server and the application devices may 
communicate with means of the Internet or any another network, and in principle they may 
be able to perform the same function as long as the electronic circuitry or the interface added 
to any of these devices can perform the desired fonctionaHty of Hie physical world, e.g. 
control a shower, control a coffee machine, etc. As a consequence of that, the server may be 
the Web tablet and vice versa. 

A computer readable medium may be magnetic tape, optical disc, digital video 
disk (DVD), compact disc (CD or CD-ROM), mini-disc. hard disk, floppy disk, smart card. 
PCMCIA card, etc. 
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1. A method of coMroUiBg application devices (103 - 106, 203, 204, 305, 405, 

408 - 412) said method comprising the steps of: 

_ retrieving first documents (501) from a first set of application devices by a server 

(107, 205, 304, 404); 
5 - retrievingidentification(115,502)ofauserbytheserver; 

characterized in that the method further comprises Hie steps of: 

- generating (505) second documents by the server, each comprising an instruction, 
on the basis of at least a part of the retrieved identification of the user and at least 

a part of the first documents; 
10 - sending(506)atleastoneoftheseconddocumentstoeachdeviceofaseconds?t 

of the application devices by the server; and 

- performing (507), for a given device ofthe second set, one instruction from at . 

least one ofthe second documents received in the given device. 
15 2. Amethodaccordingto'claiml,characterizedinthatthestepofretrieving 

identification ofthe user further comprises the steps of 

- retrieving user profile (503) information based on the user identification by the 

server; and 

- retrieving context profile information (504) relating to surroundings ofthe user by 
20 the server. 

3 Amethodaccordingtoclaiml or2,characterizedinthatthedocuments 
comprise at least one ofHyperTeKt Markup Language, ScalableVectorC3raphics, Resource 

Description Framework and Extensible Markup Language QCML). 

4 A method according to any one of claims 1 through 3, characterized in that the 
appUcation devices comprise at least one of Web tablet, set-top box, VCR. TV. PDA. lamp, 
coffee machine, radio, telephone, background wall, DVD player and electronic information 
panel. 
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5. A system for controlling application devices (103 - 106, 203, 204, 305, 405, 

408 - 412) comprising: 

- means for (1 07, 205, 304, 404) retrieving first documents from a first set of 
application devices; 

- means for (107, 205, 304, 404) retrieving identification (1 15) of a user; 
characterized in that the system further comprises: 

~ means for (107, 205, 304, 404) generating second documents, each comprising an 
instruction, on the basis of at least a part of the retrieved identification of the user 
and at least a part of the first documents; 

- means for (107, 205, 304, 404) sending at least one of the second documents to 
each device of a second set of the application devices; and 

~ means for performing, for a given device of the second set, one instruction from at 
least one of the second documents received in the given device. 

6- A system, according to claim 5, characterized in that the means for retrieving 
identification of the user further comprises: 

- means for (1 07, 205, 304, 404) retrieving user profile information based on the 
user identification; and 

- means for (1 07, 205, 304, 404) retrieving context profile mformation relating to 
surroundings of the user. 

7- A computer system for performing the method according to any one of claims 
1 through 4. 

^- A computer program product comprising program code means stored on a 

computer readable medium for performing the method of any one of claims 1 through 4 when 
the computer program is run on a computer. 
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A method and a system of controlling application devices simultaneously. The 
appUcation devices canbeaWebtablet,aset.topbox.aVCR,aTV,aPDA,alamp.acoffee 

machine, a radio, a telephone, a background wall, a DVD player or an electronic information 
panel Hxe method includes four steps controlled by a server: retrieving first documents (501) 

5 from a first set of application devices; retrieving identification (502) of auser; generatmg 
(505) second documents, each comprising an instruction, on the basis of at least a part of iHe 
retrieved identification of the nser and at least a part of the first documents; simultaneously 
sending (506) at least one of the second documents to each device of a second set of the 
application devices; and performing (507) for a given device of the second set one mstruction 

10 from at least one of lixe second documents received in liie given device. Tlxe step of retrieving 
identification by the server includes the steps of retrieving user profile (503) information 
based on 1iie user identification, and retrieving context profile infomiation (504) relating to 
present surroundings of the user. THe said documents include Hyper Text Markup Language. 
Scalable Vector CJraphics, Resource Description Framework and Extensible Markup 

15 Language (XML). 
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